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ABSTRACT 

A study was undertaken at California's College of the 
Canyons (CC) to determine whether evidence existed of 
dispropor t i onate impact in English reading course placement based on 
student ethnicity, gender, or age. Data were compiled for all 4,312 
students tested between spring 1993 and fall 1995, while the standard 
for disproportionate impact was taken from Equal Employment 
Opportunity Commission guidelines that the selection rate of any 
given subgroup should not be less than 80% of that of the majority 
group. At CC, students who score 16 out of 40 or higher on the 
English reading placement test are recommended to take associate 
degree-applicable English courses. Among the study sample, 79.3% 
(n=2,774) were recommended to take degree-applicable English reading 
courses. An analysis of the placements indicated some 
di spr opor t i onate impact by ethnic group, with the credit placement 
rate for Asian students only 77% and that for Black students only 
61.4% of the rate for White students. No evidence of di spr opor t i onat e 
impact was found, however, for either gender or age, with the rate 
for females 92.8% that of males. Based on findings it was recommended 
that follow-up inves t igat i ons be conducted to determine reasons for 
the disproportionate impact and that efforts be made to ensure that 
all students take appropriate tests. (AJL) 
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Abstract 



Analyses of the rates at which placement recommendations for 
college level and basic skills English reading courses are made, 
based upon the College Board's APS reading test, were conducted. 
Specific comparisons were made for the student background 
characteristics of ethnicity, gender, and age. Disproportionate 
impact was found in the cases of Asian students and black 
students. Follow-up investigations into the reason for the 
apparent disproportionate impact for these two groups are 
necessary if this test is going to continue to be used. 
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English Reading Course Placement Recommendations: 
An Analysis of Disproportionate Impact 



The issue of disproportionate impact as it relates to the 
assessment and placement of college students involves the extent 
to which placement rates into college level courses vary across 
subgroups of students. Differences in placement rates may be due 
to the interactive effects of a number of factors and would serve 
as a signal that a closer look at the test in question and its 
relationship with student background characteristics is needed. 
The study reported here was undertaken to determine whether there 
is evidence for disproportionate impact in English reading course 
placement at College of the Canyons. For those cases where 
disproportionate impact is found, further investigation should be 
undertaken to determine the reason for the disproportionate 
impact . 



Whi_l® the discussion of what constitutes “differential 
placement rates" continues, one standard has emerged. The 
standard comes from EEOC (Equal Employment Opportunity Commission) 
guidelines concerning disproportionate impact in employee 
selection. It holds that disproportionate impact is evidenced 
when the selection rate of an impacted group is less than 80% of 
the majority group. The guidelines make it clear that the 80% 
value should be used with some care and interpreted within the 
full context of the local setting. As an example, they note that 
"smaller differences in selection rate may constitute adverse 
impact where they are significant in both statistical and 
practical terms" and also that "greater differences in selection 
rate may not constitute adverse impact where the differences are 
based on small numbers and are not statistically significant" 
(Uniform Guidelines on Employee Selection Procedures, 1978). This 
" 8 0 % " level has been offered as a reasonable criterion for 
disproportionate impact studies of placement tests used in the 
California Community Colleges, with the primary difference being 
that placement rates into courses are targeted, rather than 
selection for employment. 
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English Reading Course Placement Recommendations 

The English reading portion of the College Board 
Assessment and Placement Services (APS) test is administered to 
incoming COC students whose primary language is English, for the 
purpose of making an initial English reading course placement 
recommendation. Data were compiled for all students who were 
tested between Spring 1993 and Fall 1995 totaling 4312 students 
for the reading test. 

According to the placement rule (see Table 1 below), 
students who score 16 or higher (out of 40 Possible) are 
recommended to take an associate degree applicable course (English 
80 or higher), while various ranges of lower scores are associated 
with recommendations for English 34 or lower. (The descriptors 
degree applicable" and "associate degree applicable" are used 
interchangeably in this report, as are "non-degree applicable" 
and "non-associate degree applicable".) Overall rates of 
placement into these courses can be readily determined, as can 
such rates for various subgroups. For purposes of assessing 
possible disproportionate impact, the critical categories are 
recommended placement into non-degree applicable courses (English 

34 or below) versus degree-applicable courses (English 80 and 
above ) . 



Placement Rule 


Table 1 

for the APS English-Reading Test 


Score Range 


Placement Recommendation 


0-9 


English 10 


10-15 


English 34 


16-24 


English 80 


25-35 


English 101 
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Student Ethnicity 



Table 2 presents the number and percent of students in 
each of the ethnic categories who were recommended to degree- 
^pplicsble and non— degree applicable English reading courses, a 
total of 79.3% of the entire sample was recommended to college 
level English courses (English 34 or above). 



Table 2 

Placement into Basic Skills and College Level English Reading Courses, 

by Ethnic Category ' 





White 


Hispanic 


Asian 


Black 


Native 

American 


Other 


Non-Degree 


425 

(15.3%) 


265 

(30.4%) 


55 

(34.8%) 


60 

(48%) 


19 

(30.2%) 


42 

(23%) 


Degree 


2349 

(84.7%) 


607 

(69.6%) 


103 

(65.2%) 


65 

(52%) 


44 

(69.8%) 


141 

(77%) 


Total 


2774 


872 


158 


125 


63 


183 


EEOC ratio 


baseline 


91% 


77% 


61.4% 


82.5% 


91% 



As noted earlier, EEOC guidelines indicate that all relevant 
subgroups should be selected (in this case, recommended for 
enrollment into English 80 or above) at a rate that is at least 
80% or the rate of the majority group. For this analysis, the 
"majority group is typically the group with the highest 
selection/placement rate. The critical value based on the EEOC 80% 
rate standard in this case is 67.8% (80% of the 84.7% rate for 
Whites ) . Therefore the placements rates for the subgroups 
Hispanic, Native American, and "other" meet the standard, but 
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Asian and blacks do not. Thus there is evidence that a 
disproportionate impact exist in placement recommendations based 
on ethnicity for these two subgroups . 

Student Gender 

Table 3 presents the number and percent of females and males 
receiving various English reading course placement 
recommendations. The sample consists of 52.9% females and 47.1% 
males. About Ninety percent of both males and females were 
recommended to degree applicable courses. Applying the EEOC 
standard, the critical percentage is 65.8% (80% of the male rate 
of 82.3%). Since the placement rate for females exceeds this 
value, there is no evidence for disproportionate impact involving 
the sex of the student being tested. 



Table 3 

Placement Into Basic Skills and College Level 
English Reading Courses, by Gender 




Female 


Male 


Non Degree 


538 


359 




(23.6%) 


(17.7%) 


Degree 


1744 


1669 




(76.4%) 


(82.3%) 


Total 


2282 


2028 


EEOC ratio 


92.8% 


baseline 
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Student Age 



Table 4 presents the placement recommendation rates into 
degree applicable and non-degree applicable English courses for 
the following age categories; 19 and below, 20-24, 25-29, 30-39, 
and over 40. While these categories do not correspond perfectly 
with the statewide MIS categories, they nevertheless divide the 
age continuum into meaningful subgroups. Further, the consistency 
in placement rates across these groups is striking. The EEOC 
guideline of 80% results in a critical value of 65.2% (80% of the 
rate of 81.5% for the age group 19 or less). All age categories 
are well above this critical value, therefore it appears that 
there is no disproportionate impact in placement recommendations 
due to the age of the student. 



Zable 3 

Placement into Basic Skills and College Level English Reading Courses, 

by Age Category 



Student's Age 





0-19 


20-24 


25-29 


30-39 


over 40 


Non Degree 


572 

(18.5%) 


147 

(16.9%) 


69 

(16.6%) 


71 

(14.7%) 


28 

(17.5%) 


Degree 


2522 

(81.5%) 


400 

(87.9%) 


190 

(73.4%) 


217 

(75.3%) 


74 

(72.5%) 


Total 


3094 


547 


259 


.288 


102 




baseline 


89.7% 


90% 


92.4% 


89% 
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Summary and Discussion 

Table 5 summarizes the analyses reported above. In the 
case of student ethnicity, there is some evidence of 
disproportionate impact in the use of the APS for placement 
recommendations of Asian and Black students. There is no evidence 
of disproportionate impact concerning gender or age. 



Table 5 

Summary of Disproportionate Impact Analyses for the APS 

Characteristic/ Outcome 

Category 



Ethnicity 
Asian 
White 
Hispanics 
Native American 
Black 



Evidence for Disproportionate Impact 
Baseline group 

No evidence for Disproportionate Impact 
No evidence for Disproportionate Impact 
Evidence for Disproportionate Impact 



Gender 

Male 

Female 



Baseline group 

No evidence for Disproportionate Impact 



Age 

19 or less 
20-24 
25-29 
30-40 

40 or more 



Baseline group 

No evidence for Disproportionate Impact 
No evidence for Disproportionate Impact 
No evidence for Disproportionate Impact 
No evidence for Disproportionate Impact 



The issue now becomes one of interpreting the evidence 
that suggests disproportionate impact exists for Asian and black 




9 



students. A large number of variables may interact to moderate 
the relationship between student ethnicity and performance on the 
APS (as well as performance in class). Stated differently, 
student background characteristics, per se, are not causes of the 
differential performance that results in the different rates of 
placement documented in this report. Rather, more immediate 
determinants of performance may vary systematically with ethnicity 
resulting in the observed relationships between ethnicity and the 
full array of outcome indices. These moderating factors may 

previous courses taken, performance in those courses and 
time since previous course taken, educational goal, experience 
with the English language, experience with tests, many other 
variables relating to educational preparation, and an assortment 
of affective and motivational variables. 

A few caveats warrant reemphasizing. First, the EEOC 
criterion is just a guideline, it would be a mistake to assume 
that all groups not identified as impacted in this study are truly 
free from such impact. Second, all information on student 
background characteristics is obtained via self-reports. While 
this method tends to be quite reliable, it is possible that in 
some cases students may have provided incorrect information, 
either intentional, or due to carelessness. 



Recommendations 

Follow— up investigations are necessary to explain why 
disproportionate impact was found in the case of Asian and 
black students. 

2. It is also possible that a number of the Asian students who 
took the APS (for native English speakers) should probably have 
taken the ESL placement tests (for non-native English 

) • Efforts to help all students to take appropriate 
tests should be strengthened. 



References 



Isonio, Steven (1992) 

English Placement Recommendations at Golden West rollpqg . 
An Analysis of Disproportionate impart 

Matriculation Local Research Options Committee (1992). 

Assessment Validatio n Project Local Research Opt i one , 
Design 12 

Matriculation Local Research Options Committee (1992) 

— a ^ r ^- cu ^ a ti° n Evaluation: Monographs On Designs From the 

Research Options Project. 



Uniform Guidelines on Employee Selection Procedures. Federal 
Register , Vol. 43, No. 166 Friday, August 25, 1978, 
pp. 38, 296-38, 309. 




® 



U.S. Department of Education 

Office of Educational Research and Improvement (OERI) 
Educational Resources Information Center (ERIC) 

REPRODUCTION RELEASE 

(Specific Document) 




06 <\^0 o\b 



I. DOCUMENT IDENTIFICATION: 



Title: 

English reading placement recommendations at 
an analysis of disproportionate impact 


College of the Canyons : 


Author(s): Joseph Gerda 


Corporate Source: 


j Publication Date: 


College of the Canyons 


| August 1996 



II. REPRODUCTION RELEASE: 



In order to disseminate as widely as possible timely and significant materiaJs of interest to the educational community, documents announced 
in the monthly abstract journal of the ERIC system, Resources in Education (RiE), are usuaJly made available to users in microfiche, reproduced 
paper copy, and electro r.ic. ; opticaJ media, and scid through the ERIC Document Reproduction Service (EDRS^ or other rRIC vendors. Credit is 
given to the source of each document, and, if reproduction release is grantsd, one of the following notices is amxad to the document. 



If permission is granted to reproduce and disseminate the identified document, please CHECK ONE of the following two options and sign at 
the bottom of the page. 



X 

Check here 
For Level 1 Release: 

Permitting reproduction in 
microfiche (4' x 6" film) or 
other ERIC archivaJ media 
(e.g., electronic or opticaJ) 
and paper copy. 



The sample sticker shown below will be The sample sticker shown below will be 
affixed to all Level 1 documents affixed to all Level 2 documents 



PERMISSION TC REPRODUCE AND 




PERMISSION TO REPRODUCE AND 


DISSEMINATE THIS MATERIAL 




DISSEMINATE THIS 


HAS BEEN GRANTED BY 




MATERIAL IN OTHER THAN PAPER 




COPY HAS BEEN GRANTED BY 


\0 






cly 






J 

TO THE EDUCATIONAL RESOURCES 




TO THE EDUCATIONAL RESOURCES 


INFORMATION CENTER (ERIC) 




INFORMATION CENTER (ERIC) 




Check here 
For Level 2 Release: 

Permitting reproduction in 
microfiche (4* x 6* film) or 
other ERIC archivaJ media 
(e.g., electronic or opticaJ), 
but not in paper copy. 



Level 1 



Level 2 



Documents will be processed as indicated provided reproduction quaJity permits. If permission 
to reproduce is granted, but neither box is checked, documents will be processed at Level ,1. 



Sign 

here-* 

please 



3 

ERIC 



m i hereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate 
this document as indicated above. Reproduction from the ERIC microfiche or electronic/optical media by persons other than 
ERICampby&es and its system contractors requires permission from the copyright holder. Exception is made for non-profit 
reppddfjctlon by libraries and other den/ice agencies to satisfy information needs of educators in response to discrete inquiries. m 




Signature: 



Sil^zanotVAcHr^; College o f the Canyons 
26455 ^Rockwell Canyon Road 
Santa Clarita, CA 91355-1899 



Printed Name/ Position/Title 

Nancy J. Mattice 

Asst. Dean, Institutional Development 

one: VPaX:* 

(805)259-8302 



(805)259-7800 x328 



E-Mail Address: 
mattice_n@canyon. 
coc . cc .ca . us 



Date: 

12/17/96 



(over) 




III. DOCUMENT AVAILABILITY INFORMATION (FROM NON-ERIC SOURCE): 

If permission to reproduce is not granted to ERIC, or, if you wish ERIC to cite the availability of the document from another source, 
please provide the following information regarding the availability of the document. (ERIC will not announce a document unless it is 
publicly available, and a dependable source can be specified. Contributors should also be aware that ERIC selection criteria are 
significantly more stringent for documents that cannot be made available through EDRS.) 



Publisher/Distributor: 




Address: 




Price: 





IV. REFERRAL OF ERIC TO COPYRIGHT/REPRODUCTION RIGHTS HOLDER: 

If the right to grant reproduction release is held by someone other than the addressee, please provide the appropriate name and address: 



Name: 

Address: 



V. WHERE TO SEND THIS FORM: 



Send this form to the following ERIC Clearinghouse: Rika Nakazawa> Acquisitions Coordinator 

ERIC Clearinghouse for Community Colleges 
3051 Moore Hall 
Box 951521 

Los Angeles, CA 90095-1521 



However, if solicited by the ERIC Facility, or if making an unsolicited contribution to ERIC, return this form (and the document being 
contributed) to: 






3 / 96 / 96 ) 



1996 IR Mailing 



